A General Class of Transfer Learning Regression without Implementation Cost
نویسندگان
چکیده
We propose a novel framework that unifies and extends existing methods of transfer learning (TL) for regression. To bridge pretrained source model to the on target task, we introduce density-ratio reweighting function, which is estimated through Bayesian with specific prior distribution. By changing two intrinsic hyperparameters choice model, proposed method can integrate three popular TL: TL based cross-domain similarity regularization, probabilistic using estimation, fine-tuning neural networks. Moreover, benefit from its simple implementation without any additional cost; regression be fully trained off-the-shelf libraries supervised in original output variable simply transformed new variable. demonstrate simplicity, generality, applicability various real data applications.
منابع مشابه
Improved estimators for a general class of beta regression models
In this paper we consider an extension of the beta regression model proposed by Ferrari and Cribari-Neto (2004). We extend their model in two different ways, first, we let the regression structure be nonlinear, second, we allow a regression structure for the precision parameter, moreover, this regression structure may also be nonlinear. Generally, the beta regression is useful to situations whe...
متن کاملStatistically adaptive learning for a general class of cost functions (SA L-BFGS)
We present a system that enables rapid model experimentation for tera-scale machine learning with trillions of non-zero features, billions of training examples, and millions of parameters. Our contribution to the literature is a new method (SA L-BFGS) for changing batch L-BFGS to perform in near real-time by using statistical tools to balance the contributions of previous weights, old training ...
متن کاملActive Learning for Multi-Class Logistic Regression
Which of the many proposed methods for active learning can we expect to yield good performance in learning logistic regression classifiers? In this article, we evaluate different approaches to determine suitable practices. Among our contributions, we test several explicit objective functions for active learning: an empirical consideration lacking in the literature until this point. We develop a...
متن کاملTransfer Learning Based on Logistic Regression
In this paper we address the problem of classification of remote sensing images in the framework of transfer learning with a focus on domain adaptation. The main novel contribution is a method for transductive transfer learning in remote sensing on the basis of logistic regression. Logistic regression is a discriminative probabilistic classifier of low computational complexity, which can deal w...
متن کاملImportance Weighted Inductive Transfer Learning for Regression
We consider inductive transfer learning for dataset shift, a situation in which the distributions of two sampled, but closely related, datasets differ. When the target data to be predicted is scarce, one would like to improve its prediction by employing data from the other, secondary, dataset. Transfer learning tries to address this task by suitably compensating such a dataset shift. In this wo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2021
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v35i10.17087